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(§4) Monitoring system to measure flight characteristics of moving sports object 

(57) A sports object flight monitoring system in- 
cluding at least two shutterable camera units 
each of which receives light patterns from each 
and every one of a plurality of contrasting areas 
on the object in rapid successive sequence. A 
computer receives the signals generated by the 
light patterns as received by each camera unit 
to determine the object's flight characteristics. 
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Background of the Invention 

Ball monitoring devices for using multiple electro-sensors to determine the angle of launch, spin rate and 
speed of sports objects are old (U.S. Patent No. 4,136,387 and 4,158,853). 

5 

Summary of the Invention 

Broadly, the present invention comprises a portable system for monitoring the initial fight of an object in 
which multiple reflective areas or contrasting areas are located on the object which areas emit light to a plurality 
10 of cameras which receive a plurality of successive light patterns representing instances in the objects initial 
flight The light patterns received by the cameras are processed by computer which compares known calibra- 
tion light patterns with the received signals from the object during flight to compute initial flight characteristics 
of the object. 

It is a feature of the system that it is compact, automatic and portable and can be readily calibrated on 

15 site. 

It is also a feature that the use of multiple reflective or contrasting areas on the object permits two cameras 
to receive sufficient data despite initial object flight rotation. 

Brief Description of the Drawings 

20 

Figure 1 is a perspective view of the apparatus of the present invention position adjacent a teed golf ball; 
Figure 2 is a perspective view of a three-dimensional field showing a golf ball passing through the field 
from position A to position B; 

Figure 3 is a perspective view of a calibration fixture carrying twenty illuminable areas; and 
25 Figure 4 is a plan view of the light receiving and sensory grid panel located in each camera. 

Brief Description of the Preferred Embodiment 

Referring to the Figures, system 3 in Figure 1 includes camera housing unit 4, computer 5, acoustical sen- 
30 sor 6 and teed golf ball 8. Camera unit 4 includes housing frame 11 and support feet 12a, 12b engageable with 
tracks 14, 16sothatthe unit4can be adjusted relative to teed ball 8. Camera unit 4 further includes two electro- 
optical spaced-apart cameras 18, 19, which cameras have light-receiving apertures 18a, 19a, shutters (not 
shown) and light sensitive silicon panels 18p, 1 9p (see Figure 4). CCD cameras are preferred but TV-type cam- 
eras are also useful. 

35 Turning to Figure 2, golf ball 8 has dimples 8d and six (6) reflective spaced-apart round areas or dots 20a- 

f. Round dots 20a-f having diameters of one-tenth (1/10)(2.5 mm) to one-eighth (1/8) of an inch (3 mm) are 
preferred but other size and shaped areas can be used. Dots 20a-f are preferably made of reflective material 
which is adhered to the ball surface. The "Scotchlite" brand beaded material made by Minnesota Mining and 
Manufacturing (3M) is preferred. Corner-reflective retrof lectors may also be used. Alternatively, painted spots 

40 can be used that define contrasting areas. The number of dots or areas may be as few as three (3) up to six 
(6) or more provided each dot or area reflects light in ball position Aand B capable of being receivable by camera 
1 8, 1 9. Camera 1 8 is capable of receiving light from each and every dot 20 a-f and camera 1 9 is likewise capable 
of receiving light from each and every dot 20 a-f. The angle between lines A and B on Fig. 1 may be in the 
range of 10-30° with 22° being preferable. 

45 Reflective materials as compared with the coated surface of a golf ball are as high as nine hundred (900) 

times brighter where the divergence angle between the beam of light striking the dots 20 a-f and the beam of 
light from the dots 20 a-f to the camera aperture is zero or close to zero. As the divergence angle increases 
the ratio of brightness of the dots a-f to the background (remaining ball surface) decreases. It will be appreci- 
ated that infra red lighting may be used to make the flash light invisible to the golfer. 

so Adjacent to camera 1 8 are two flash lamps 21 , 22 and adjacent to camera 1 9 are two additional flash lamps 
23, 24. Lamps 21, 22, 23 and 24 are placed as close to the operative of camera 18, 19 as possible to minimize 
the divergence angle and this increases the ability of the cameras 18, 19 to receive light from dots a-f and 
distinguish that light from light received from other portions of the ball surface and other background light Al- 
ternatively, gating or shuttering can be accomplished by controlling the periods of time in which the light sen- 

55 sitive panels 18p, 19p will receive light and be activated by such light. A camera in which shuttering or gating 
is accomplished by operation of the sensor panels is a gated charge intensified camera. In this alternative, 
the light source is always on with camera shutters always open, thus employing the panels 18p, 19p to ac- 
complish gating by gathering light only at two timed periods separated by 800 microseconds. A second alter- 
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native utilizes a ferroelectric liquid crystal shutter which opens and closes in 100 microseconds. In this alter- 
native, a constant light source is used and shuttering occurs twice after the bail has been hit 

In the operation of the system, the initial step is calibration of the cameras 18, 19. The cameras 18, 19 
are calibrated to a coordinate system fixed in space. To accomplish this calibration, fixture 30 of Figure 3 is 

5 physically located just ahead of where teed ball 8 will be placed. The fixture includes twenty (20) retro-dots 
30a-t of 1/4"(6.25 mm) in diameter. Fixture 30 defines the global coordinate system by its three dimensional 
structure. The location of fixture 30 and spacing of cameras 18, 19 from the fixture 30 or each other need not 
be precise since the fixture 30 locates these when it determines the eleven constants for each camera 1 8, 1 9. 
The eleven constants determine the focal length, orientation and position of each camera 18, 19 given the 

10 premeasured points on fixture 30 and the twenty U and V coordinates digitized on each camera's sensor panels 
18p, 19p. 

Sensor panels 18p, 19p which receive a light pattern contain 240 lines of data and 510 pixels per line. The 
grid of Fig. 4 is merely illustrative in that it does not have 240 lines. A computer algorithm is used for centroid 
detection of each dot 20 a-f. Centroid detection of a dot is the location of the center area of the dot for greater 
15 accuracy and resolution. Each image received from dots 20 a-f results in an apparent x and y center position 
of each dot 20 a-f. Where light is low in the field of vision due to gating, an image intensifier may be used in 
conjunction with the sensor panels. An image intensifier is a device which produces an output image brighter 
than the input image. 

The X, Y and Z coordinates of the center of each dot 30 a-t were premeasured to accuracy of one of one- 
20 ten thousandth of an inch (0.00254 mm) on a digitizing table and stored in the computer. An image of the cal- 
ibration fixture 30 is taken by the two cameras 18, 19. 

This image determines the eleven (11) constants relating image space coordinates U and V to the known 
twenty X, Y and Z positions on the calibration fixture 30. 

The equations relating the calibrated X(i), Y(i), Z(i) spaced points with the U,(j), V,(j) image points are: 

25 

„U) , DijXU) +D 2j r(i) +D„Z(i) +D 4j 

30 

i=l,20 

V U) 0 DyXU) +D sj ni) +D„ZU) +D Bi 



The eleven constants, DM (i = 1, 11) for camera 18 and the eleven constants, Di2 (i = 1, 11) for camera 19 are 
solved from knowing X(i), Y(i), Z(i) at the 20 locations and the 20 U,(j), V,(j) coordinates measured in the ca!i- 

40 bration photo for the two cameras. 

With calibration completed, ball 8 which has been positioned about 30 inches from cameras 18 and 19 is 
struck and launched through three-dimensional field of view 35 (Fig. 2). Upon launch, the noise of striking is 
picked up by an acoustical sensor 6 which transmits a signal to open the shutter of camera 1 8 and camera 1 9 
and to expose the image sensor panel in camera 18 and camera 19 to light from the six (6) ball dots. One hun- 

45 dred microseconds later, flash light 22 and light 23 fires a flash of light which illuminates the six (6) ball dots. 
Eight hundred (800) micro seconds later flash light 24 and light 21 fire a flash of light to illuminate the six (6) 
ball dots which are about 4 to 6 inches (101.6 to 152.4 mm) along the initial flight path in field 35. Rashes of 
light are between one-ten thousandth and a few millionths of a second in duration. Very small apertures are 
used in cameras 18 and 19 to reduce ambient light and enhance strobe light. As light reflects off dots 20 a-f 

50 in their two positions it reaches sensor panels 18p, 19p in corresponding panel areas 25 a-f. 

Using the known ball 8 dimensions, the known time between camera operation and the known geometric 
relationships between the cameras, the external computing circuits are able to calculate the X, Y and Z pos- 
itions of each enhanced spot in a common coordinate system at the time of each snapshot. From the position 
information and the known data the external computing circuits are able to calculate the ball velocity and spin 

55 in three dimensions during the immediate post-launch time period. Given the initial velocity and spin, plus 
known aerodynamic characteristics of the ball 8, the external computing circuits are capable of accurately pre- 
dicting the flight path and point of landing of the ball. 

Three-dimensional monitoring of ball 8 that has a radius of .84 inches (21.33 mm) is accomplished by rep- 
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resenting the X f Y, Z position of each dot on ball 8 by its center of mass location TX, TY, TZ and its orientation 
matrix with angles A, E f T. The position of each dot (M , 2 6) is given by the matrix coordinate transformation 



'x(i) 




TX 


Yd) 
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TY 


z(i). 







M{A, E, T) 



• 84 sin 8(i)cos 

. 84 sin 6(i) sin e(i) 

.84 cos 8(i) 



10 in which 9(i), 0(i) are the spherical polar coordinate position of the dots 20 a-f on the surface of ball 8 and 
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is the orientation matrix. 



The orientation matrix, M, gives the three dimensional orientation transformation connecting the body coor- 
dinates of ball 8 with the f be global reference coordinate system calibrated earlier. The column vector (.84 sin 

20 8(i) cos 0(i), .84 sin 6(i) sin 0(i), .84 cos 9(1)), gives the position of a dot labeled i in the body fixed coordinate 
system. The optimum arrangement of dots 20 a-f is one pole dot at 0°,0° and the five surrounding dots are at 
9(i)=30° and 0(i)=O°, 72°, 144°, 21 6°, 288°. An angle of theta much greater than 40° will not allow all six dots 
on the ball in the optimum configuration of the system to be captured on severely hooked or sliced golf shots. 
The resulting equations to be solved given the camera coordinates, U,(J) ( V,(i>, for the six dots, i, and two 

25 cameras j are as follows: 



U) m DxjXii) +D 2i Y(i) +D„Z(i) +D A1 
1 D 9j X(i) *D 10J Y(i) +D lxj Z(i) +1 



i=l,6 
J-1,2 

v u) o D 5j X(i) +D S1 YU) ^jjZU) +0^ 
1 D 9J X(i)+D lQJ Y(i) +D xlj Z 



The resulting twenty-four equations are solved for TX, TY, TZ and orientation angles A, E, T for the ball's 
40 first location. A similar set of twenty-four equations are solved for in the second location position of the ball. 
The twenty-four equations are nonlinear and are solved iteratively linearizing by using Taylor's theorem. Gen- 
erally, the equations converge to a solution for the six unknown parameters in four iterations. 

The velocity components of the ball along the three axis of the coordinate system are then computed from 
the formulae: 



Ut + AT)- 




AT 




TJt + AT)- 




AT 




Tift + AT) - 




AT 



in which AT is the time interval between strobe firings. 

The spin components result from multiplying the orientational matrix M(A,E,T,t) and M(A',E',T',t+AT) and 
equating the off diagonal elements of the resulting relative orientation matrix. 

A(U + AT) = M(t + AT)M T (t) 

55 Then the magnitude, 9, of the angle of rotation vector of the two balls during the time increment AT is given 
by: 

9 = sin- 1 (tt2) 
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where R = Vl 2 + M 2 + N 2 

= ^23-^32 

M = 4 31 - i4 13 
W = iA 12 - 4 21 

The three orthogonal components of spin rate, Wx, Wy, Wz, are given by: 

W x = sirr 1 (RI2) U (RAJ) = QU (RAT) 

W y = sin- 1 (RI2)MI (RAT) = 9M/ (RA7) 

W z = sin-U^N/^AT) = 0N/(RA7) 
Other objects such as golf dubheads, baseballs, footballs, soccerballs, hockey pucks etc. may also be 
monitored using the system described. 



Claims 



1. A system for monitoring the initial portion of the flight of an object through a field of view comprising: 

(a) a support means for the object; 

(b) a portable housing including at least two cameras in fixed relationship in such housing; 

(c) a first camera unit in such housing having a light sensitive panel, said first camera unit being focused 
on the field of view through which the object passes during the initial portion of its flight; 

20 (d) a second camera unit in such housing having a light sensitive panel focused on the field of view; 

(e) means for shuttering or gating the camera units at least twice as the object passes through the field 
of view; 

(f) three or more contrasting areas on the object positioned so that light emitting from such areas reach- 
es such light sensitive panels to form light patterns thereon and create analog image signal when the 
camera shutters are open; and 

(g) image digitizing means in or near such portable housing for receiving such analog signals to deter- 
mine the path of the object, its speed and spin during such initial portion of flight 

2. The system of claim 1 in which the shuttering means is a flash means which emits light in two flashes 
30 onto the object 

3. An apparatus for measuring in a field the flight characteristics of a sports object passing through a field 
having a plurality of illuminable areas thereon comprising: 

(a) a first and a second spaced-apart electro-video unit in a portable housing, each unit having a shutter 
35 focused on the object in the field; 

(b) measuring means in the electro-video units which recognize the position of calibrated illuminal areas 
in the field; 

(c) at least three light reflecting dot means on the object; 

(d) a plurality of flash lights for lighting the field; 

4> (e) control means for opening and closing each shutter and energizing each light such that a light illu- 

minates the object in the field when the object is at a first position and when it is at a second position; 

(f) light receiving means in the electro-video unit for receiving light from the dot means when the object 
is at the first position and at the second position; and 

(g) computer means in or near the housing for comparing the calibrated dot positions at first position 
45 with the dot positions at the second position. 

4. The system of claim 1 in which its object has six (6) contrasting areas. 

5. The system of claim 1 in which all means except the computer means and support means are located in 
50 the portable housing. 
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